iCLEF 2001 at Maryland: Comparing Term-for-Term Gloss and MT
نویسندگان
چکیده
For the first interactive Cross-Language Evaluation Forum, the Maryland team focused on comparison of term-for-term gloss translation with full machine translation for the document selection task. The results show that (1) searchers are able to make relevance judgments with translations from either approach, and (2) the machine translation system achieved better effectiveness than the gloss translation strategy that we tried, although the difference is not statistically significant. It was noted that the “somewhat relevant” category was used differently by searchers presented with gloss translations than with machine translations, and some reasons for that difference are suggested. Finally, the results suggest that the F measure used in this evaluation is better suited for use with topics that have many known relevant documents than those
منابع مشابه
iCLEF 2001 at Maryland: Comparing Word-for-Word Gloss and MT
For the rst interactive Cross-Language Evaluation Forum, the Maryland team focused on comparison of term-for-term gloss translation with full machine translation for the document selection task. The results show that (1) searchers are able to make relevance judgments with translations from either approach, and (2) the machine translation system achieved better e ectiveness than the gloss transl...
متن کاملiCLEF at Maryland Comparing Word for Word Gloss and MT
For the rst interactive Cross Language Evaluation Forum the Maryland team focused on com parison of term for term gloss translation with full machine translation for the document selection task The results show that searchers are able to make relevance judgments with translations from either approach and the machine translation system achieved better e ectiveness than the gloss translation stra...
متن کاملParticipant Before break
For the rst interactive Cross-Language Evaluation Forum, the Maryland team focused on comparison of term-for-term gloss translation with full machine translation for the document selection task. The results show that (1) searchers are able to make relevance judgments with translations from either approach, and (2) the machine translation system achieved better eeectiveness than the gloss transl...
متن کاملiCLEF at Sheffield
Sheffield’s contribution to the interactive cross language information retrieval track took the approach of comparing user’s abilities at judging the relevance of machine translated French documents against ones written in the users’ native language: English. Conducting such an experiment is challenging, and the issues surrounding the experimental design are discussed. Experimental results stro...
متن کامل